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CONCAVE  MINIMIZATION  VIA  COLLAPSING  POLYTOPES 

by 

James  E.  Falk 
Karla  L.  Hoffman 

1.  Introduction 

In  [l],  the  authors  introduced  the  Successive  Underestimation 
Method  (SUM)  for  the  minimization  of  a  concave  function  over  a  (bounded) 
polytope.  This  method  has  the  features 

(a)  it  is  a  finite  procedure, 

(b)  it  does  not  involve  cuts  of  the  feasible  region, 

(c)  it  does  not  require  any  accounting  scheme  to  keep  track  of 
subproblems , 

(d)  it  generates  a  sequence  of  linear  programs, 

(e)  it  employs  only  pivoting  operations,  and 

(f)  it  is  guaranteed  to  terminate  at  a  global  solution. 

The  method  which  we  are  introducing  in  this  paper  has  similar 
characteristics  and,  indeed,  has  a  similar  interpretation  in  that  both 
methods  seek  a  global  minimizer  by  successively  collapsing  containing 
polytopes  around  the  feasible  region.  The  method  by  which  these  polyy  ^ 
topes  are  collapsed  is,  however,  very  different.  /.  '*V 
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In  SUM,  at  iteration  k  ,  one  has  a  polytope  containing  the 

feasible  region  S  .  This  polytope  has  both  a  representation  in 

terms  of  linear  inequalities  (e.g.,  A^x  <  bi  ,  i e  Ifc)  ,  and  also  a 

representation  in  terms  of  its  vertices  (i.e.,  {w4  j e J^}  is  the  set 

of  vertices  of  S.  ) .  Both  of  these  representations  are  known  at  itera- 

jk 

tion  k  .  To  proceed,  one  selects  the  most  promising  vertex  w  of 
,  and  identifies  a  halfspace  x  <_  b  which  does  not  contain 

.  4  k 

J  k 

w  .  This  halfspace  is  then  added  to  the  halfspaces  defining  Sfc  to 
create  .  One  must  then  generate  the  new  vertices  defining  Sk+^  , 

and  this  is  the  most  expensive  part  of  the  algorithm. 


By  contrast,  in  our  new  method,  we  will  only  carry  along  the 
vertex  representation  of  S,  .  As  before,  the  most  promising  vertex 

4 

w  of  S,  is  selected,  but  now  we  generate  S,  .  by  listing  the 

4  4  v 

neighbors  of  a  point  v  associated  with  w  in  a  space  of  dimen- 

4 

sion  one  greater  than  the  dimension  of  w  .  The  new  vertices  defining 
Sk+^  will  be  identified  by  these  neighbors  (and  there  will  be  at  most 

n+1  of  them) .  Thus  the  amount  of  work  required  to  pass  from  iteration 
k  to  kV  greatly  reduced. 


A  pleasant  by-product  of  the  proposed  method  is  that  redundant 
constraints  do  not  affect  the  computation  (as  they  do  in  SUM).  This 
fact  was  established  by  Mattheiss  [2],  who  proposed  a  method  similar  to 
the  scheme  we  will  present,  but  for  the  generation  of  all  vertices  of  a 
poly tope.  Indeed,  our  method  may  be  viewed  as  our  original  algorithm, 
SUM,  modified  along  the  lines  proposed  by  Matthiess  for  a  different 
problem. 


It  is  intended  that  a  reader  of  this  paper  need  not  be  intimately 
aware  of  the  results  of  [1]  and  [2],  i.e.,  we  intend  this  paper  to  stand 
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alone.  However,  we  will  not  repeat  the  proofs  of  those  results  that  we 
need  from  those  references. 

In  Section  2,  we  will  list  the' assumptions  and  notation  that  we 
use  later  on.  The  algorithm  will  be  presented  here,  along  with  a  pair 
of  illustrative  examples.  Section  3  contains  the  necessary  proofs,  and 
computational  results  are  contained  in  Section  4. 

2.  The  Method  of  Collapsing  Polytopes 

The  problem  that  we  address  has  the  form 

minimize  f (x)  j 

J  Problem  P 
subject  to  Ax  <_  b  J 

where  f  is  a  concave  function  defined  over  Rn  ,  and  A  is  an  ra*n 
matrix  with  m  >  n  .  We  shall  assume  that 

(a)  the  set  S  ■  {x:  Ax^b}  is  compact, 

(b)  S  has  a  nonempty  interior, 

(c)  x >  0  for  all  xe  S  , 

(d)  any  basic  solution  of  the  system  C  **  {v*  (x,y) :  Ax+ay£b} 
(a  ■  ( | | AjJ  | , . . . , | | A^ | | ) )  is  nondegenerate ,  and 

(e)  the  solution  of  the  linear  program 

maximize  y  \ 

j  Problem  CP 
subject  to  Ax+ay  <_  b) 

is  unique. 

Assumption  (a)  guarantees  the  existence  of  a  solution  to  problem 
P,  but  it  is  also  necessary  to  Invoke  it  according  to  the  nature  of  the 
algorithm  that  we  are  proposing.  Assumption  (b)  is  also  essential,  as 
our  method  needs  to  identify  a  center  of  the  feasible  region.  Via  As¬ 
sumption  (e),  that  center  will  be  unique,  and  this  will  significantly 
simplify  our  description  of  the  method.  Likewise,  Assumptions  (c)  and 
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(d)  are  not  essential,  but  rather  convenient  to  invoke  for  expository 
purposes.  In  particular,  under  (d)  any  vertex  of  the  set  C  is  deter¬ 
mined  by  precisely  n+1  hyperplanes  of  the  form  +  | |A±| |y  —  b^  . 

Note  that  the  feasible  region  S  -  {x:  Ax<  b}  can  be  interpreted 
as  that  n-face  of  the  set  C  *  {(x,y):  Ax+ay  <_  b}  for  which  y»0  . 

In  particular,  the  vertices  of  S  are  those  vertices  of  C  for  which 
y  ■  0  . 

If  x  £  S  ,  the  Euclidean  distance  between  x  and  a  hyperplane 
A^x  *  b^  is 

bi  -  V 

TT^TT  * 

Thus  the  quantity 


measures  the  distance  from  x  to  the  nearest  bounding  hyperplane  of 
S  .  It  follows  that  the  solution  (x°,y°,s°)  of  the  problem  CP, 

maximize  y 

subject  to  Ax  +  ay  +  s  -  b 
x,y,s  >  0 

yields  a  point  x  E  S  which  is  the  center  of  the  largest  sphere  con¬ 
tained  in  S  .  The  value  y*^  is  the  radius  of  this  sphere. 

Because  of  Assumption  (d) ,  the  solution  (x°,y°,s°)  of  CP  is 
nondegenerate.  Since  there  are  m  equality  constraints  defining  CP,  it 

follows  that  exactly  m  of  the  components  of  (x^,y^,s®)  are  positive. 

Because  of  (c),  x° > 0  ,  and  because  of  (b),  y° > 0  .  Thus  the  n+1 

nonbasic  components  of  (x^,y^,s^)  are  among  the  components  of  s^  . 
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The  first  step  in  our  algorithm  will  be  to  Identify  the  n+1 
neighbors  (x^,y^,s^)  of  (x^.y^.s®)  .  This  can  be  done  algorithmic- 
ally  by  representing  (x^,y^,s^)  in  tableau  form  and  pivoting  in  those 
n+1  components  of  s^  which  are  zero  (see  Figure  1) . 


BN  . 

x  y  s  s  rhs 


Figure  1. — The  last  tableau  of  CP. 


In  order  to  generate  the  first  enclosing  polytope  of  S  , 

we  need  to  extend  the  rays  beginning  at  (x°,y®)  and  passing  through 

the  neighbors  (x^y*)  until  these  rays  pierce  the  hyperplane  y=0  . 

It  will  be  shown  in  Section  3  that  this  is  possible  for  each  of  the 

neighbors  (x^.y*)  of  (x^,y^)  .  Algorithmically,  this  is  accomplished 
by  simply  pivoting  on  each  element  in  that  row  which  corresponds  to  the 

(basic)  variable  y  in  the  tableau  representing  (x^,y^,s®)  .  Such 

pivots  result  in  points  e*  which  may  or  may  not  be  feasible  to  S  . 

We  will,  however,  show  in  Section  3  that  S  is  a  subset  of  the  convex 
hull  of  these  points. 

At  stage  k  ,  we  will  have  a  tree  whose  terminal  nodes  vfc  - 

(xt,yt)  will  be  vertices  of  C  ,  where  C  -  (v*  (x,y):  Ax+ay£b}  . 
(This  is  consistent  with  the  tree  built  by  Matheiss  [2]  to  generate  all 
vertices  of  a  polytope.)  Associated  with  each  of  these  nodes  will  be  a 
value  f£  corresponding  to  the  objective  function  f  evaluated  at  a 

point  associated  with  vC  .  We  will  choose  that  vertex  vC  which  has 
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an  associated  value  that  is  minimal  over  all  such  terminal  ver¬ 

tices. 


Given  that  tableau  which  represents  vC  ,  we  see  from  Assumption 
(d)  that  there  are  precisely  n+l  neighbors  of  vC  on  C  .  However, 
we  only  focus  on  those  neighbors  vC,i  *  (xC,i  ,  yt,i)  such  that 

(a)  yC’^  <  yC  ,  and 

(b)  vt’i  is  not  a  member  of  the  tree  associated  with  stage  k  . 

Neighbors  staisfying  (a)  can  be  identified  from  the  tableau  representing 

vC  .  The  row  of  that  tableau  corresponding  to  the  variable  y  repre¬ 
sents  the  equation 


y  +  l 

j  nonbasic 


a«8j 


t 

y  • 


Thus,  the  only  columns  j  which  are  eligible  for  consideration  under 
(a)  have  a^  >  0  .  Those  columns  ineligible  under  (b)  must  be  identi¬ 
fied  by  a  tree  search,  which  can  be  facilitated  by  the  values  yfc  and 


As  before,  we  extend  the  rays  emanating  from  vC  through  the 

points  vt,i  until  they  pierce  the  plane  y-0  .  This  is  accomplished 
by  pivoting  on  the  entry  a^  identified  above.  The  result  is  a  set  of 

(at  most  n+1  )  points  e6’*  .  We  compute  the  values  f  ,  ■  f(et*^)  , 

and  associate  these  values  with  the  neighbors  vC,i  .  (The  vertex  vt,i 
obtained  by  doing  the  usual  ratio  test  to  determine  the  leaving  vari¬ 
able.  ) 


We  will  show  in  Section  3  that  S  is  a  subset  of  the  convex  en¬ 


velope  of  the  points 


{eC} 


from  stage  k 


but  excluding  the  particular 
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point  eC  whose  associated  vC  was  used  to  extend  the  tree,  but  in¬ 
cluding  the  newly  generated  points  et,i  . 

We  may  summarize  the  algorithm  as  follows. 


Initialize: 


Solve  problem  CP  and  obtain  solution  vC 
(x°,y°)  .  Set  fQ  -  »  , 


T0  *  >f0)}  * 

Select  Branching  Node:  With  given,  select  a  terminal  node  v*” 

whose  associated  value  f  is  minimal  over  all 


such  terminal  nodes.  If  the  associated  y1" »  0 
stop  with  global  solution  x*  *  xC  and  f*  * 


Step: 


Generate  all  neighbors  v1"’1  of  vC  such  that 
(a)  yt,i  <  yt  ,  and 


(b)  v'-1  t  Tk  . 

For  each  such  vl 


compute 


and  ft,i  *  •  The  tree  Tk+1  is  the 
Cree  w*t*1  new  n°des  vt,d  satisfying  (a) 
and  (b)  above,  and  with  links  joining  vC  to 
these  new  vC'*  . 
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Example  1: 


The  problem  we  wish  to  solve  is 

minimize  -(x^-2)^  -  (x2~2)^ 
subject  to  xi  +  *2  =  ^ 


3x^  +  5x2  <  27 
-6x^  +  10x2  <  30 


This  example  was  constructed  so  that  there  are  four  global  minimizers, 
and  all  vertices  of  S  need  to  be  generated.  The  final  tableau  of 
problem  CP  is  given  in  Table  1.  The  circled  entries  indicate  pivot  ele¬ 
ments  which  yield  the  three  neighbors  of  v^  =  (x^,y^)  =  ((1.799,2.201), 
1.611)  on  C  .  The  starred  entries  indicate  pivots  which  yield  the  ex¬ 
tended  neighbors  of  v°  .  The  fact  that  one  entry  is  both  circled  and 
starred  indicates  that  a  pivot  here  will  yield  a  neighbor  (x^.y^) 
where  x1  is  actually  feasible  to  S  . 

The  complete  solution  tree  is  given  in  Figure  2.  A  global  solu¬ 
tion  was  found  at  node  4,  but  not  verified  as  such  until  the  alternate 
solution  at  nodes  8  and  9  were  generated. 

The  geometrical  history  of  the  collapsing  polytopes  is  depicted 
in  Figure  3. 


Example  2: 

This  problem  is  based  on  a  problem  derived  by  Zwart  [4]  as  a 
counterexample  toTiu's  original  method  [3]  for  minimizing  concave  func¬ 
tions  over  polyhedra.  The  problem  is 
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Stage 


FEASIBLE 


FEASIBLE 


x  =■  (0.000,1.000) 

y8-0 

fg  -  -5.000 


FEASIBLE 


x  -  (1.000,0.000) 
y9  -  0 
f9  -  -5.000 


FEASIBLE 


Figure  2. — The  tree  for  Example  1. 
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minimize  -(x^-l)^  -  x^  -  (x^-l)^ 


subject  to  4x^  - 

5x2  + 

4Xj 

> 

4 

6x^  - 

x2  * 

X3 

> 

4.1 

x,  + 

x„  - 

X, 

< 

1 

1 

2 

3 

12x^  + 

5x2  + 

12x3 

< 

00 

• 

co 

12x^  +  12x2  +  7x^  ^29.1 

^1  *  x2  *  x3  i  ®  • 

The  algorithm  required  three  stages  to  uncover  and  verify  the  global 
solution  at  x*  =  (1,0,0)  .  An  interesting  feature  of  this  example  oc¬ 
curs  in  the  first  stage,  where  problem  3  is  selected  for  branching.  As 

expected,  (x^,y^)  has  four  neighbors,  one  of  which  is  (x^,y^)  .  How- 

4  4 

ever,  there  is  also  a  neighbor  that  is  already  on  the  list  ((x  ,y  )), 
and  hence  should  not  be  added  again,  in  spite  of  the  fact  that  the  y 
value  associated  with  this  neighbor  (0.147)  is  smaller  than  the  current 

3 

y  *  0.214  value.  Thus  a  list  search  is  necessary. 

The  branch  and  bound  tree  is  depicted  in  Figure  4,  and  the  geo¬ 
metrical  history  of  the  method  is  depicted  in  Figure  5. 

3.  Proof  of  Convergence 

In  order  to  prove  convergence  of  this  method,  it  suffices  to  show 
that  (a)  the  initial  polytope  generated  by  the  convex  hull  of  the  ex¬ 
tended  neighbors  of  v^  contains  the  feasible  region  S  ,  and  (b)  if 
the  polytope  associated  with  tree  T^  contains  S  ,  then  the  polytope 

associated  with  T^+3  contains  S  .  Since  we  are  growing  trees  whose 

nodes  are  in  one-to-one  correspondence  with  vertices  of  C  ,  the  method 
must  be  finite. 
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The  vertices  of  C  form  a  directed  graph  G  -  {v,E}  with  edges 
(v^v*)  £  E  if  and  only  if  vs  -  (xs,ys)  and  vC  ■  (xt,yt)  are  neigh- 

S  *  t  f 

boring  vertices  on  C  ,  and  if  y  >  y  (i.e.,  x  is  closer  to  the 

g 

boundary  of  S  than  is  x  ) .  The  algorithm  that  we  are  describing 
will  specify  a  sequence  tq>t^ . Tp  °f  subtrees  of  G  such  that 

(a)  Tq  ■  {(x^,y^)}  where  x®  solves  problem  CP, 

(b)  is  defined  from  T^  by  selecting  a  terminal  vertex 

^k 

v  of  Tk  ,  generating  all  neighbors  v  of  v 

which  are  not  already  in  T  ,  and  whose  associated  dis- 

tance  values  y  are  smaller  than  y 


The  actual  selection  process  defined  in  (b)  above  will  be  dic¬ 
tated  by  the  branch  and  bound  rule  already  specified.  Note  that,  by 
construction, 

T.CT.  C...CT  . 

0  1  p 

Note  also  that  any  particular  vertex  vC  of  G  has  exactly  n+1 
neighbors,  but  not  all  such  neighbors  are  eligible  for  appendage  to  T^ 

in  defining  T^+^  (except  in  moving  from  Tq  to  T^  ,  when  all  neigh¬ 
bors  of  v^  ■  (x^,y^)  join  v^  to  define  T^  ) .  In  particular,  ter¬ 
minal  vertices  vt  of  the  form  vC  *  (xt,0)  have  no  neighbors  that  are 
eligible  candidates  and  hence  cannot  be  used  to  proceed  from  T^  to 


Associated  with  each  subtree  T^  will  be  a  polytope  enclos¬ 
ing  C  ,  and  hence  a  polytope  enclosing  S  .  We  now  proceed  to  de¬ 

fine  these  polytopes.  Let  vC  ■  (xt,yt)  be  a  vertex  of  T^  .  Let 
N(vC)  denote  the  set  of  all  vertices  vt,^‘  which  are  neighbors  of  vC 
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on  C  ,  and  let  K(vC)  denote  the  cone  in  Rn"*’*  whose  vertex  is  vC 
and  whose  defining  rays  are  rt’^  ■  {v:  v  ■  vC  +  X(vC,i-v);  X  >  0}  for 
each  vt,i  e  N(vC)  .  The  set  is' defined  to  be 

c  «  n  k^) 

vCeT. 

k 

i.e.,  is  the  intersection  of  all  cones  defined  at  vertices  of  . 

We  are  primarily  interested  in  the  projection  of  the  set 
onto  the  hyperplane  y  *  0  which  contains  S  .  Thus  we  define 

Sk  -  {x:  (x,y) e  Ck>  . 

We  now  wish  to  show  that 

S0  3  S1  3  3  Sk3  S  •  W 

Theorem  1:  S  C  SQ  . 

Proof:  Cq  is  defined  from  Tq  ,  whose  only  vertex  is  v°  - 
(x^.yO)  ,  the  point  which  solves  problem  CP.  Thus  CQ  is  the  cone  de¬ 
fined  by  the  n+1  inequalities 

AlX  +  | | A± | |y  <  b± 

where  i  is  such  that  A^x^  +  I |A^| |y  ■  b^  ,  since  it  has  already  been 
shown  in  Section  2  that  there  must  exist  precisely  n+1  nonbasic  slack 
variables  in  the  tableau  defining  (x  ,y  )  .  Now  xeS  if  and  only  if 
A^x  £  b.^  for  all  i*l,...,m  ,  so  that  (x,0)  must  satisfy  the  above 
n+1  <  m  inequalities. 

Theorem  2 :  S,  . ,  C  S,  . 

-  k+1  k 
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Proof :  As  is  a  subset  of  ,  it  follows  that  Ck+^  C 

Hence  Sk+1  -  Cfc+1  H  {y-0}  C  H  {y-0}  -  . 


Theorem  3:  S  C  for  any  k  . 


Proof:  Any  of  the  cones  K(v  )  defining  has  the  hyperplane 

description 

K(vC)  *  j(x,y):  A^x  +  ||a^| jy  <_  for  those  n+1  indices  i 

such  that  A^x*1  +  |  |A^  |  |yC  »  b^  |  . 

As  such,  it  must  contain  the  set  S  .  Hence 

S  C  Kfv11)  for  all  vertices  v1"  of  , 


so  that 


SC  n  K(vC)  . 


vteT, 


These  three  theorems  establish  (1) .  We  note  in  particular  that 

any  sequence  of  trees  Tq  CT^  CTj  C  ...  must  be  finite.  Indeed,  the 

largest  and  last  tree  generated  in  any  such  sequence  must  have  all 

of  the  vertices  of  S  among  the  terminal  vertices  of  T^  .  Mattheiss 

[2]  actually  generates  such  a  tree  T^  in  order  to  list  all  vertices 

of  S  .  He  uses  the  distance  measuring  variable  y k  of  the  terminal 

vertices  vC  "  (xC,yC)  of  T^  to  define  Tk+^  ,  and  hence  has  control 

of  the  size  and  order  of  the  list  of  terminal  vertices  of  T,  . 

k 


Since  we  are  interested  in  minimizing  concave  functions  over  S 
as  opposed  to  generating  all  vertices  of  S  ,  we  will  be  using  the  value 
of  the  objective  function  f  over  the  vertices  of  to  determine 
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T,  .  from  T,  .  We  do  this,  of  course,  to  avoid,  whenever  possible, 

C'  X  K 

the  complete  generation  of  all  vertices  of  S  .  We  will,  however,  use 
the  values  yC  to  order  our  list  of  vertices  of  for  easy  access. 

In  order  to  proceed  from  to  ,  we  reed  a  vertex  des¬ 
cription  of  (as  opposed  to  the  current  description  0 

{y*0}  ).  Consider  any  particular  cone  K(vC)  defining  .  Let 
r***  *  {v:  v  =  v^  +  A(vt’^'  -  vC) ;  A  ^  0}  be  one  of  the  defining  rays  of 
,  where  v*’*  is  a  neighbor  of  vC  .  Either  vC,i  £  ,  in  which 

case  K(vt,i)  is  also  a  cone  defining  ,  or  v*"’1  t  . 

If  vt,i  e  Tk  ,  and  if  vC  is  such  that  yC  <  y11’1  ,  then  the 

ray  rt,i  does  not  pierce  the  plane  y  *  0  .  For  any  point  v  e  rt,:L 
has  the  form 

v  -  (x,y)  *  +  A(xt’i-xt)  ,  yt  +  A(yt,i-yt)) 

so  that  y  >  0  for  all  A  ^  0  . 

If  vt,;L  e  Tk  ,  and  if  we  have  yC  >  y*’1  ,  then  the  ray  rC,i 

does  pierce  the  plane  y  *  0  ,  but  at  a  point  (et,:^,0)  ,  which  lies 

outside  of  .  This  follows  since  the  ray  r6**  is  determined  by 

precisely  n  hyperplanes  (the  n  hyperplanes  which  vC  and  vt’^ 

t  i  t  i 

have  in  common) ,  and  the  point  v  ’  is  that  point  where  r  ’  pierces 

the  (n-H)st  hyperplane  defining  vt’^'  (see  Figure  6).  Since  rt’^’  is 

feasible  to  C,  between  vC  and  vC’^  ,  it  must  become  infeasible 
k 

thereafter. 

Finally,  we  must  consider  the  case  where  vt’^'  ^  .  Again,  we 

have  two  subcases:  yC  <  yC ’ ^  and  yC  >  yt*^‘  .  As  before,  in  the  first 
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Figure  6. — An  infeasible  extension. 


case,  the  ray  rt*^'  does  not  pierce  y  ■  0  .  In  the  second  case,  how¬ 
ever,  rt,i  does  pierce  y  ■  0  in  a  point  (et,i,0)  .  Here,  finally, 
we  have  a  defining  vertex  of  .  If,  in  fact,  the  point  were  not 
feasible  to  ,  it  would  follow  that  the  ray  rt’*  would  have  to 
pierce  some  other  hyperplane  defining  ,  and  hence  would  have  to  pass 
through  some  neighbor  of  vC  .  But  we  had  assumed  the  contrary. 

Summarizing  the  preceding  discussion,  we  can  define  the  genera¬ 
tors  of  to  be  those  points  e"*  found  by  selecting  a  terminal 

vertex  vC  of  ,  and  a  neighbor  vt’*'  of  vC  such  that 

(a)  vt,i  is  not  in  ,  and 

,,,  t,i  ,  t 

(b)  y  ’  <  y  . 


I  Then  e  ■  x  +  A  (x  -  xC)  where 

j  t,i 

i 


The  actual  mechanics  of  computing  the  generators  of  are  not 

difficult.  If  we  have  the  tableau  of  the  full  system  Ax  +  ay  ■  b  in  a 
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form  which  exhibits  vC  ■  (xt,yt)  ,  we  can  easily  determine  which  non- 
basic  columns  decrease  the  value  of  y  when  pivoted  into  the  basics. 
The  precise  value  of  A  above  is  then  determined  by  driving  y  to 
0  (ignoring  feasibility) . 


Referring  to  Figure  7,  suppose  that  we  have  the  tableau  repre¬ 
senting  vC  *  (xt,yt)  .  Since  yfc  >  0  ,  the  variable  y  must  be  basic, 
and  hence  y  must  have  the  representation 

.  n  -  N  , 
y  +  I  aij8j  -  bt  . 


Now  a  pivot  in  column  j  (i.e.,  make  s”  basic)  will  result  in  a  de¬ 
creased  value  of  y  only  if  a^  >  0  .  For  such  entries  a^  ,  a  pivot 
in  these  entries  themselves  will  decrease  y  to  0  (i.e.,  make  y  non- 
basic),  although  it  may  yield  points  x  which  are  infeasible  to  S  . 

The  collection  of  all  such  x's  resulting  in  such  pivots  yields  the  new 
vertices  of  ,  provided  vt,i  is  not  in  T^  .  The  latter  proviso 

requires  a  list  search  (the  list  of  vertices  of  T^  ) ,  but  is  facili¬ 
tated  by  the  distance  measure  y**’^  . 
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4.  Implementation  and  Computational  Experience 

As  already  stated,  there  are  three  phases  to  the  collapsing  poly¬ 
topes  algorithm:  (1)  the  initialization  phase,  which  requires  the  so¬ 
lution  of  a  linear  program  and  the  subsequent  generation  of  the  enclos¬ 
ing  polyhedron  using  simple  pivot  calculations;  (2)  the  branching  stage, 
which  requires  the  removal  from  a  list  of  the  terminal  node  whose  objec¬ 
tive  function  value  is  minimal;  and  (3)  the  generation  of  new  neighbors. 
This  third  stage  requires  that  simplex-like  pivots  be  performed  and  all 
nodes  generated  and  not  previously  on  the  list  be  added  to  the  list. 

Our  implementation  of  this  algorithm  uses  the  linear  programming 
package  SEXOP,  developed  in  1972  by  Dr.  Roy  E.  Marsten  for  all  pivot 
calculations . *  Two  modifications  have  been  made  to  SEXOP:  (1)  pivots 
can  be  made  on  any  element  in  a  given  basis  tableau,  regardless  of 
feasibility  considerations;  and  (2)  one  can  obtain  the  results  of  a 
pivot  operation  without  actually  changing  the  current  tableau  represen¬ 
tation  (we  shall  refer  to  such  operations  as  pseudo-pivots) . 

In  order  to  obtain  the  information  necessary  for  branching  strat¬ 
egies,  a  simple  pointer-structured  list  is  maintained  which  is  ordered  by 
objective  function  value.  This  list  is  linked  to  a  second  list  ordered 
by  the  sum  of  the  indices  of  the  nonbasis  variables  which  represent  that 
vertex.  This  second  list  carries  along  with  each  nonbasis  sum  value, 
the  indices  of  the  nonbasic  variables.  This  index  information  is  all 
that  is  necessary  to  set  up  the  tableau  for  any  vertex. 


*The  authors  are  aware  that  Dr.  Marsten  has  recently  developed  a 
new  linear  programming  package,  XMP,  which  is  both  more  efficient  and  more 
stable  than  the  earlier  SEXOP  package.  XMP  will  replace  SEXOP  for  all 
linear  programming  calculations  in  the  concave  minimization  code  as  soon 
as  the  necessary  modifications  to  that  package  have  been  made.  However, 
since  all  computational  results  reported  in  this  paper  use  SEXOP  and 
since  only  counts  on  the  number  of  pivot  operations  (rather  than  CPU 
time  required  for  such  pivots)  are  reported,  we  believe  the  comparative 
conclusions  drawn  will  not  be  altered  by  the  substitution. 
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At  the  branching  stage,  one  need  only  remove  the  top  entry  from 
the  first  list  and  its  associated  index  information  from  the  second  list. 
Given  a  branching  node,  one  then  generates  its  neighbors.  One  deter¬ 
mines  if  each  of  these  neighbors  is  added  to  the  list  by  checking 
whether  there  exists  a  variable  on  the  second  list  whose  nonbasic 
indices  sum  equals  that  outained  for  this  new  vertex.  If  such  an 
entry  exists,  then  one  does  a  further  check  to  insure  that  each  nonbasic 
index  matches.  If  it  does,  the  vertex  is  not  entered  on  the  list.  If  a 
match  does  not  occur,  one  also  checks  a  "tombstone"  list  (also  ordered 
by  nonbasic  indices  sum)  to  assure  that  the  vertex  had  not  been  gener¬ 
ated  previously  and  subsequently  removed.  If  no  match  occurs  on  either 
list,  this  new  vertex  is  entered  in  both  the  list  ordered  by  objective 
function  value  and  linked  to  the  list  ordered  by  nonbasic  indices  sum. 

We  shall  refer  to  the  computer  implementation  of  this  algorithm  as 
CONCAVE. 


To  evaluate  how  well  this  code  performs  on  a  variety  of  problem 
types,  it  was  compared  to  two  other  computer  codes.  The  first,  SUM,  is 
an  implementation  of  the  earlier  algorithm  developed  by  the  authors. 

This  code  is  modular ly  designed  with  all  input,  output,  simplex  opera¬ 
tions,  and  (where  possible)  list  structure  routines  identical  to  those 
used  by  CONCAVE. 

As  mentioned  earlier,  SUM  requires  that  both  a  tableau  and  a 
constraint  representation  of  each  vertex  on  the  list  be  maintained.  The 
other  features  of  this  algorithm  which  differ  in  code  structure  from 
that  of  CONCAVE  are: 

(1)  A  linear  program  is  solved  in  order  to  find  the  leaving 
vertex  (branch  selection) . 

(2)  Once  the  leaving  vertex  is  chosen,  one  must  remove  it  from 
the  list  of  vertices  which  together  determine  the  enclosing 
poly tope.  Since  this  vertex  is  not  necessarily  the  vertex 
with  the  lowest  objective  function  value,  a  search  of  the 
list  for  this  specific  vertex  must  take  place.  Having 


22  - 


T-438 


ordered  Che  list  in  the  same  manner  as  that  for  CONCAVE 
does,  however,  help  in  the  search  since  the  vertex  sought  is 
the  one  which  contributed  most  to  the  low  value  of  the  un¬ 
derestimation  function,  i.e.,  an  infeasible  vertex  with 
small  objective  function  value. 

(3)  After  determining  the  leaving  vertex,  one  then  finds  the 
associated  constraint  to  be  added.  One  must  then  be  certain 
that  no  other  vertices  on  the  list  violate  this  constraint. 
(If  any  does,  it  too  must  be  removed.)  Thus  a  test  of  each 
(infeasible)  vertex  must  be  made. 

(4)  This  algorithm  requires  that  only  one,  list  be  maintained, 
ordered  by  objective  function  value,  with  the  values  of  the 
vertices  and  their  basis  representation  carried  along.  No 
"tombstone"  list  need  be  maintained  by  CONCAVE. 

The  third  code  which  was  used  in  the  comparison  is  a  code  devel¬ 
oped  by  T.Mattheiss,  called  ALVERT,  which  generates  all  vertices  of  a 
poly tope.  Obviously,  one  method  of  solving  concave  minimization  prob¬ 
lems  is  to  generate  all  vertices  and  choose  the  one  whose  objective 
function  is  minimum.  The  code  ALVERT  was  modified  to  store  not  all 
vertices  generated,  but  rather  only  those  needed  for  future  calculations 
(nonterminal  vertices)  and  the  one  terminal  vertex  whose  objective  func¬ 
tion  value  is  minimal  among  all  terminal  vertices  generated  so  far. 

The  Testing 

All  computational  testing  was  performed  on  a  UNIVAC  1108  computer 
under  EXEC  level  36R2D  Operating  System,  using  the  FTN  Compiler,  level 
9R1.  This  FORTRAN  compiler  is  an  optimizing  compiler  allowing  many  of 
the  new  syntax  rules  of  the  ANSI  FORTRAN  77  standard. 

We  used  as  our  performance  measures:  (1)  the  number  of  pseudo¬ 
pivots,  (3)  the  number  of  actual  pivots,  and  (3)  the  maximum  number  of 
elements  on  the  list.  We  do  not  report  any  accuracy  measures  since  all 
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three  codes  produced  the  same  answer  both  in  objective  function  value 
and  in  solution  vector  (to  10  ^  accuracy)  on  all  problems  tested. 

We  again  ran  the  four  problems  presented  In  [ l] .  The  results 
appear  in  Table  1.  In  addition  to  these  small  examples  used  primarily 
for  feasibility  testing,  the  major  test  effort  involved  the  pseudorandom 
generation  of  poly topes  coupled  with  the  generation  of  concave  objective 
functions  having  linear  fixed  charges  or  negative  quadratic  terms.  For 
each  problem  type,  25  problems  were  randomly  generated  and  the  numbers 
reported  are  the  averages  obtained  from  those  25  problems.  In  the 
tables  below  we  present  the  results  of  this  test  effort.  Note  that  for 
problems  of  a  specific  size,  all  that  was  altered  between  tables  was  the 
type  of  objective  function  to  be  minimized.  ALVERT  was,  therefore,  run 
only  once  for  each  problem  size  and  this  run  summarized  the  results  of 
generating  all  vertices  for  each  of  the  25  problems  of  that  type. 

A  number  of  conclusions  can  be  drawn  from  the  data  obtained  in 
this  test  effort: 

(1)  For  problems  of  the  size  tested,  neither  the  size  of  the 
fixed  charge  nor  the  size  of  the  negative  quadratic  term  has 
a  significant  effect  on  the  computational  effort  required  to 
solve  these  problems. 

(2)  Both  SUM  and  CONCAVE  appear  to  outperform  ALVERT  for  the 
types  of  problems  tested. 

(3)  CONCAVE  appears  to  be  superior  to  SUM  for  problems  of  the 
types  tested. 

These  results  indicate  that  successively  underestimating  the 
objective  function  by  enclosing  the  feasible  region  in  polytopes  which 
decrease  in  size  at  each  iteration  is  a  promising  approach  for  concave 
minimization  problems. 
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